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MOBILE RESEMBLANCE ESTIMATION 

Field of the Invention 

The present invention relates to a method for resem- 
blance estimation, a server and a system for resemblance 
estimation and use of the method. 

5 

Background Art 

Identifying and authenticating techniques are today 
used, inter alia, in various log-on processes which are 
required in order to get access to technical equipment 

10 or be admitted to locked premises. 

A method for identification is described at the 
Internet address www . viisage . com/f acexplore . htm and is 
based on a recorded image being matched against images 
which are stored in a database. The result of the match- 

15 ing can then be used in identification of people to 

give them access to computers or for authentication for 
e-commerce . 

A drawback of the method, however, is that the tech- 
nique is adapted to reliably prove that the person in 

20 the image is identical with the person in the item in the 
database. This places high demands on input data, which 
implies that the parameters for input data are relatively 
complex. For instance, input data is a video sequence 
where the system chooses parameters to ensure whether a 

25 recorded person represented by the parameters is identi- 
cal with a person whose parameters are stored in a data- 
base . 

An example of another method for voice identifica- 
tion is known from US 6,411,926, which discloses a system 
30 where voice commands are recorded and sampled so as then 
to extract parameters from the digitised voice signal 
using a digital signal processor. These parameters are 
fed into a microprocessor which compares them with voice 
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templates in a database. The digital signal processor is 
a "vocoder" (voice-operated coder) . The technique tries 
to process the recorded voice to find out what it is say- 
ing. A difficulty in the technique is finding a voice 
5 template among a limited choice of adapted voice tem- 
plates to control, for instance, menu handling in a 
mobile phone using voice commands. 

A known method is available in the form of Internet- 
based services such as www . amialookalike . com , 

10 www . amiredneckornot . com or www . ratemybody . com . These ser- 
vices involve sending an image of a person, for instance 
of oneself, and then other users are to vote in order for 
the service to give a result. A drawback of the method is 
that for results, other users must participate and vote. 

15 Moreover it often takes a long time before voting is 

finished, or alternatively there is no deadline for vot- 
ing, in which case a definite result fails to appear. The 
estimation of the result will also be highly dependent on 
who and how many people vote, which means that the quali- 

20 ty of the result will not be very high. This makes the 
service less attractive. Sent in pictures must be pub- 
lished to other users, which may jeopardise the user's 
integrity. 

25 Summary of the Invention 

The object of the present invention is to provide a 
method for estimating the resemblance of a large group of 
users . 

According to a first aspect, the invention relates 
30 to a method for estimating the resemblance of various 

objects, comprising the steps of recording data of a real 
object using a communication device, transferring said 
recorded data to a service server, extracting a compari- 
son object from said recorded data, making a resemblance 
35 analysis between the comparison object and a previously 
stored object, and transferring result data containing 
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information about the resemblance analysis to a result 
unit. 

The method can be used in estimating how much a 
recorded object resembles a previously stored object. 
5 There may be a plurality of previously stored objects, 
and the resemblance analysis can be made on these pre- 
viously stored objects. The real object can be, for 
example, an animal or a man. Using a communication 
device, it is possible to record data, such as sound, 

10 image or both. The communication device can be, for 

example, a computer which is connected via a computer 
network, such as the Internet, and which via the computer 
network can transfer information to a service server. The 
service server can be an ordinary PC (Personal Computer) 

15 which is connected to the computer network. 

The step of transferring said recorded data may com- 
prise the steps of transmitting said recorded data and 
receiving said recorded data in the service server. 

The information about the resemblance analysis may 

20 comprise the degree of resemblance of the comparison 
object to a previously stored object. The resemblance 
can be stated as a value that may be within a range. 
The value can be defined so that the closer to the upper 
limit of the range the value is, the greater the degree 

25 of resemblance of the comparison object to the stored 

object. If the resemblance analysis is made on a plura- 
lity of stored objects, the object with the greatest 
resemblance can be selected. Result data may contain the 
stored object with the greatest resemblance and the value 

30 of the resemblance. Result data may also contain infor- 
mation about the stored object which the comparison 
object resembles most. 

The result unit can be available in the service 
server. It can also be an external unit belonging to the 

35 owner of the service server. In this result unit, results 
from the resemblance analysis can be stored so as to be 
presented when required. 
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An advantage of the method according to the present 
invention is that specific software is not necessary in 
the communication unit, but currently available communi- 
cation units can be used, which are capable of recording 
5 the data whose resemblance is to be estimated. 

Another advantage is thus that it is easy for a user 
to use the method since he can use a communication device 
with which he is already familiar. 

Yet another advantage of the method is that it 
10 allows a large number of new services which can be of 
public utility or of a more entertaining character. 

Another advantage of the method is that it can be 
used by a large group of users. Each user can use his 
own communication device and transfer data to a common 
15 service server. 

Yet another advantage of the method is that the 
resemblance analysis can be made automatically by soft- 
ware in the service server. This means that the resem- 
blance analysis can provide an objective and reliable 
20 result. 

In one embodiment of the method, the step of trans- 
ferring said recorded data to a service server occurs at 
least partly wirelessly. 

An advantage of this is that the communication 
25 device can be mobile. This means that the user can take 
the communication device along and activate the method 
when desired. It is, of course, necessary for him to have 
access to a mobile network where he is positioned. 

The mobile communication device can be, for example, 
30 a mobile phone or a PDA (Personal Digital Assistant) . 

This can be advantageous for several occupational 
groups such as policemen, who can use the method at the 
scene of a crime for instance. A sound or image record- 
ing can be recorded and transmitted for estimation of 
35 the resemblance to previously stored sounds or images. 

In another embodiment of the method, the step of 
transferring said recorded data to a service server com- 
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prises the steps of packaging said recorded data as a 
message, transferring the message and unpackaging the 
message in the service server. 

The message can be, for example, an e-mail. The 
5 advantage of using a message is that this is a well- 
functioning way of transferring data. By using a message, 
a communication device or the service server need not be 
connected to the network all the time, but can be con- 
nected and receive the message when convenient. 

10 One more advantage of using a message is that the 

method will be easy to implement since the intended 
users, who are ordinary people, will in future have 
mobile phones of their own which are connected to ope- 
rators supporting message functions. 

15 In another embodiment, the method further comprises 

the steps of transferring the identity of the communica- 
tion device to the service server and storing the iden- 
tity in the service server. 

The identity of the communication device can be a 

20 phone number, e-mail address or IP (Internet Protocol) 
number. These steps are carried out for the service 
server at a later stage to be able to contact the com- 
munication device from which said recorded data came. 

The identity can be stored temporarily or for a long 

25 time, depending on how the identity is to be used. 

In one embodiment of the method, the result unit 
consists of the communication device. 

This means that the user of the communication device 
can obtain information about the resemblance analysis he 

30 initiated. The user can obtain information about who in 
the object database the recorded object resembles most 
and how much the recorded object resembles this stored 
object. 

An advantage of this method is that the user will 
35 obtain quick feedback on the resemblance analysis. 

In one embodiment of the method, said result data 
contains an address link. 
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The link can be an address of an Internet page at 
which the user can find more information about, for 
instance, the resemblance analysis. Said result data may 
also contain a key which can be a password enabling the 
5 user to log on to his page with his personal settings, 
where his resemblance analyses are stored. If the user 
has a mobile phone, he can via WAP ( (Wireless Application 
Protocol) connect to the page in question. The service 
server can be arranged with a WAP server so that the con- 
10 nection occurs directly to the service server. 

In another embodiment of the method, said recorded 
data is a digital image. 

The resemblance analysis can then be made, for 
instance, on a face using some type of face recognition 
15 program. It can also be used to determine the species of 
animals based on their appearance, or determine the breed 
of dogs. 

In one embodiment of the method, said recorded data 
is a sound recording. 

20 The resemblance analysis can then be made on a given 

voice to find a stored voice resembling the recorded 
voice. It may be a singing voice for instance. The resem- 
blance analysis can also be made on a sound of an animal 
to determine the species of the animal. 

25 In another embodiment of the method, said recorded 

data is a digital image and a sound recording. 

The resemblance analysis is then made both on an 
image and on a sound, after which these two properties 
can be weighted together. An advantage of being able to 

30 use both image and sound is the possibility of a greater 
entirety in the resemblance estimation. 

In another embodiment of the method, the service 
server comprises a number of stored objects, and the 
resemblance analysis comprises the step of identifying 

35 the stored object which most resembles the comparison 
object. 
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Determining which stored object most resembles the 
comparison object can be carried out, for instance, by 
calculating a value according to the degree of resem- 
blance of the comparison object to a certain stored 
5 object. The higher the value, the greater the resem- 
blance . 

In one embodiment of the method, said result data 
contains the identified object which the comparison 
object resembles most, and a measure of the degree of 
10 resemblance. 

The measure of the degree of resemblance can be a 
numerical value within a predetermined range. The measure 
can be defined so that the higher the value, the greater 
the resemblance of the comparison object to the iden- 
15 tified object. 

In one embodiment of the method, said result data 
contains additional information about the stored object 
which the comparison object resembles most. 

This additional information can be facts about the 
20 stored object. If the stored object, for instance, repre- 
sents a person, the additional information can be the 
name and telephone number of the person. 

In another embodiment, the method comprises the step 
of storing the comparison object in the service server. 
25 By storing the comparison object in the service 

server, the stored objects can be increased. The compa- 
rison object can then be used in future resemblance ana- 
lyses . 

In one embodiment of the method, the communication 
30 device is a mobile phone. 

In another embodiment of the method, the message 
is an MMS (Multimedia Message Service) message. 

If an address link is to be sent with result data, 
this address link can be attached to result data which 
35 in this case is an MMS. 

In one embodiment, the method further comprises the 
steps of sending, in response to transferred data, a form 
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to the communication device, recording form data using 
the communication device, transferring said recorded form 
data to the service server, the step of making the resem- 
blance analysis comprises the step of using said form 
5 data in the resemblance analysis. 

When the service server receives said recorded data, 
it transfers, in response, a form to the communication 
device. The form may comprise questions- that are neces- 
sary to supplement the resemblance analysis. The use of 

10 the communication device can, for instance, enter the 

particulars that are demanded in the form. Form data may 
comprise the particulars that have been entered by the 
user and recorded by the communication device. Form data 
may be, for instance, the name, sex and age of the user. 

15 If the object database comprises many objects, the resem- 
blance analysis can use form data to find the object 
which bears the greatest resemblance based on the data 
recorded in the first step as well as form data such as 
age. With form data the resemblance analysis can be made 

20 more relevant since the demanded object is defined more 
clearly and more distinctly. 

According to a second aspect, the invention relates 
to a method for estimating the resemblance of various 
objects, comprising the steps of receiving data, extract- 

25 ing a comparison object from said data, making a resem- 
blance analysis between the comparison object and' a pre- 
viously stored object, and transmitting result data con- 
taining information about the resemblance analysis. 

In one embodiment of the method, the received data 

30 is an MMS message. 

In another embodiment, the method comprises the 
steps of sending, in response to received data, a form, 
and receiving form data, the step of making the resem- 
blance analysis comprising the step of using said form 

35 data in the resemblance analysis. 

This method has essentially the same advantages as 
described above. 
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According to a third aspect, the invention relates 
to a server for estimating the resemblance of various 
objects, comprising a receiver which is adapted to 
receive data, an object database which is adapted to 
5 store an object, a service handler which is adapted to 
extract a comparison object, an object recogniser which 
is adapted to make a resemblance analysis between the 
comparison object and the stored object, and a trans- 
mitter which is adapted to transmit result data contain- 
10 ing information about the resemblance analysis. 

In one embodiment, the server comprises a factual 
database which is adapted to store information about the 
stored object. 

In another embodiment, the server comprises a WAP 
15 server. 

In one embodiment, the server comprises an SMS 
(Short Message Service) transmitter. 

The SMS transmitter can be used to send an SMS mes- 
sage to an external unit. An SMS message may contain 
20 information about the address of the server so that the 
external unit can connect to the server at a later stage. 

In one embodiment, the server comprises an i-mode 
server . 

In one embodiment of the server, the receiver is an 
25 MMS receiver. 

The server has essentially the same advantages as 
described above. 

According to a fourth aspect, the invention relates 
to a system for estimating the resemblance of various 
30 objects, comprising a communication device which is 

adapted to record data of a real object and transfer said 
recorded data to a server which is arranged as claimed in 
any one of claims 20-23, via a network which at least 
partly is wireless. 
35 The system has essentially the same advantages as 

described above. 
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According to a fifth aspect, the invention relates 
to use of the method as claimed in any one of claims 1-17 
in a TV programme to make a resemblance analysis between 
a previously stored object and a large number of compari- 
son objects which are extracted from received recorded 
data . 

The method according to the present invention can 
be used, for instance, in competitions in a TV programme 
where the stored object in each part is a special celeb- 
rity and where the competition involves identifying the 
televiewer who participates in the competition and who 
most resembles the celebrity of this part. The televiewer 
participating in the competition can, for instance, use 
his own mobile phone to record an image of himself and 
then transmit the image to the service server of the TV 
programme for resemblance analysis. 

Brief Description of the Drawings 

The invention will now be described in more detail 
with reference to the accompanying schematic drawings, 
which by way of example illustrate different embodiments 
of the invention. 

Fig. 1 is a schematic front view of a portable com- 
munication device. 

Fig. 2 is schematic block diagram of some components 
of the portable communication device shown in Fig. 1. 

Fig. 3 is a schematic block diagram of a server 
according to a first embodiment of the present invention. 

Fig. 4 is a schematic block diagram of a server 
according to a second embodiment of the present inven- 
tion. 

Fig. 5 is a schematic block diagram of a server 
according to a third embodiment of the present invention. 

Fig. 6 is a schematic block diagram of a system 
according to the present invention. 

Fig. 7 is a flow chart of a general method according 
to the present invention. 
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Fig. 8 is a flow chart of a method in the mobile 
phone according to a first embodiment of the present 
invention . 

Fig. 9 is a flow chart of a method in the server 
5 according to a first embodiment of the present invention. 

Description of Preferred Embodiments 

With reference to Figs 1-2, a portable communication 
device according to a first embodiment of the invention 

10 will be described in the following. The communication 
device is shown in Fig. 1 and is, in this embodiment, a 
mobile phone 1. The mobile phone 1 can be any available 
device for mobile telecommunication systems, such as GSM 
(Global Service for Mobile Transmission) , CDMA (Code 

15 Division Multiple Access), UMTS (Universal Mobile Tele- 
communications System), PDC (Pacific Digital Cellular), 
AMPS (Advanced Mobile Phone System) or D-AMPS (Digital 
AMPS) . 

The mobile phone 1 comprises an aerial 10, a loud- 
20 speaker 11, a display 12, a plurality of keys 13, a 

microphone 14, a digital camera 15 with a lens 16 and a 
release 17. The digital camera 15 can be fully integrated 
into the mobile phone 1 or be detachable and, for use, be 
mounted on the mobile phone 1 by the user. The digital 
25 camera 15 can also be a separate unit which can transmit 
an image to the mobile phone 1 via a cable. Transmission 
can also occur wirelessly by, for example, Bluetooth or 
some other type of short distance radio communication, 
such as IR. 

30 Fl 9- 2 shows some components of the mobile phone 1 

in the context of the invention. A control unit 20 is 
responsible for the overall operation of the mobile phone 
1 and is advantageously implemented with a commercially 
available microprocessor such as a CPU (Central Process- 

35 ing Unit), a DSP (Digital Signal Processor) or some other 
programmable logical unit. 
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The control unit is connected to a radio interface 
10, 24 comprising an aerial 10 and a radio circuit 24. 
The radio interface 10, 24 is responsible for establish- 
ing and maintaining a wireless connection 21 to the base 
5 transceiver station 22. The radio circuit 24, which is 
well known to a person skilled in the art, comprises a 
series of analog and digital electronic components, which 
together constitute a radio receiver and radio transmit- 
ter. The radio circuit 24 comprises, for example, band- 

10 pass filter, amplifier, mixer, local oscillator, low-pass 
filter, AD converter etc. 

The control unit 20 is also connected to an elec- 
tric memory 23, such as a RAM memory, a ROM memory, an 
EE PROM memory, a flash memory, or a combination of these. 

15 The memory 23 is used for various tasks by the control 
unit 20, one of them being to store data and program 
instructions which constitute a man-machine interface, 
which comprises a keypad 25 and a display 12. The control 
unit 20 is further connected to the digital camera 15, by 

20 means of which a digital image can be recorded. 

Service Server 

Fig. 3 is a block diagram of a service server 100 
according to a first embodiment of the present invention. 
25 The service server 100 can be an ordinary PC. The service 
server 100 comprises a message receiver 101, a service 
handler 102, an object recogniser 103, an object database 
104, a factual database 105 and a message transmitter 
106. 

30 The service handler 102 is responsible for the over- 

all operation of the service server 100 and is advanta- 
geously implemented with a commercially available micro- 
processor, such as a CPU (Central Processing Unit) , or 
some other programmable logical unit. The object recog- 

35 niser 103 can be implemented in the same unit as the ser- 
vice handler 102, and they can together constitute a con- 
trol unit for the service server 100. 
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The object database 104 and the factual database 
105 are implemented with a non-volatile memory, such as 
a hard disc. 

The message receiver 101 and the message transmitter 
5 106 constitute a radio interface. 

The owner of the service server 100, which can be a 
service provider, can create an item in the object data- 
base 104 by entering, for instance, a portrait of a known 
person. The portrait is entered as an object which is 
10 described by a number of parameters. Moreover, a link to 
an item in the factual database 105 is created, in which 
data about the known person can be stored. This can be 
name, sex, age, length, weight, profession, hair colour, 
eye colour, description of the person, curriculum vitae 
15 etc. The information can be created as an XML document 
(extensible Markup Language) to make it easier to add 
facts . 

The service server 100 codes received messages to a 
suitable format and stores the coded object temporarily. 

20 

General Method 

A method according to a first embodiment of the 
invention will now be explained in general with reference 
to the flow chart in Fig. 7. 

25 The user records in step 40 data of a real object 

using the communication device 1. The communication 
device 1 transmits in step 41 recorded data to the ser- 
vice server 100. The service server 100 extracts in step 
42 a comparison object from the recorded data. The compa- 

30 rison object is represented by a number of predetermined 
parameters which describe the recorded object. The ser- 
vice server 100 makes a resemblance analysis in step 43 
and compares the comparison object with objects 
previously stored in the service server. The service 

35 server transmits in step 44 result data containing 

information about the resemblance analysis to a result 
unit 1; 100. 
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A detailed Embodiment 

Next the method will be explained in more detail 
with reference to the block diagram in Fig. 6 and the 
flow charts in Figs 8 and 9. 
5 The mobile phone 1 is arranged, when a user presses 

the release 17, to record in step 50 a digital image by 
means of the digital camera 15. In this embodiment, the 
user records a digital image of his face. The control 
unit 20 packages in step 51 the digital image as an MMS 

10 (Multimedia Message Service) message. The control unit 20 
transmits in step 52 the MMS via the radio interface 10, 
24 over a mobile network 402, to an MMSC (Multimedia 
Message Service Center) 403. The MMS message is sent on 
to the service server 100, 405 via the Internet 404. The 

15 MMS message can also be sent via a mobile network to the 
service server 100, 405. In step 60, the service server 
100, 405 receives the MMS message via the Internet 404 
by means of the message receiver 101 which is a software 
component. In step 61, the message receiver 101 stores 

20 the user's identity, such as phone number, e-mail address 
or IP number (Internet Protocol) temporarily in order to 
know the sender of the message. 

In step 62, the message receiver 101 activates the 
service handler 102 and, in step 63a, unpackages the MMS 

25 to digital image format. In step 63b, the service handler 
102 forwards the digital image to the object recogniser 
103. In step 64, the object recogniser extracts from the 
digital image an object, which in this case describes the 
face of the user. An object is represented by a number of 

30 parameters which are selected so that the object will be 
described with sufficient accuracy. How accurately an 
object is to be described may be due to the requirements 
that are placed to ensure a correct comparison, which may 
be due to, for instance, the field of application. 

35 In step 65, the object recogniser 103 makes a resem- 

blance analysis by comparing the parameters which repre- 
sent the received object with parameters which represent 
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stored objects in the object database 104 to find the 
stored object which resembles the extracted object most. 
The stored objects describe different faces. Different 
parameters are weighted to different extents. In order 
5 to make the resemblance analysis, it is possible to use 
the face recognition such as "Eigenf aces" , which is also 
called PCA (Principle Component Analysis) and which is 
used by Viisage in their face recognition software, or 
"Local Feature Analysis" which is used by Indentix (pre- 
10 viously Visionics) face recognition software, Facelt, 

LFA. More information about the technology is to be found 
at the Internet address 

http: //www. pcquest.com/content/depth/101100105 .asp . 

The factual database 104 contains additional infor- 

15 mation about the objects that are stored in the object 
database 104. This may involve, for instance, the name 
and age of the people whose faces are represented by 
the stored objects. In step 66, the service handler 102 
creates a result message containing the best matching 

20 objects from the object database 104, information in a 
linked item in the factual database 105 regarding this 
object, and a measure of the degree of matching. 

The result message may thus contain information that 
the user resembles Elvis Presley most, that he resembles 

25 him at a given value, for instance 79 of 100 possible, 
information about Elvis Presley and a portrait of Elvis. 
The value is calculated by comparing different parameters 
and weighting them in a suitable manner. It will then be 
possible to present the stored object which the received 

30 object resembles most by comparing the different values 
that have been calculated. The message transmitter 106 
transmits, in step 67, the result message as an MMS mes- 
sage over the Internet 404 to MMSC 4 03. MMSC 4 03 forwards 
the MMS message over the mobile network 402. The mobile 

35 phone 1 receives the MMS message from the mobile network 
402. 
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Alternative Embodiments 

In another embodiment of the invention, which will 
be described with reference to Fig. 4 and Fig. 9, the 
service server 100 comprises a message receiver 201, a 
5 service handler 202, an object recogniser 203, an object 
database 204, a WAP (Wireless Application Protocol) 
server 207, a factual database 205, an SMS transmitter 
208 and a message transmitter 206. The message receiver 
201, the service handler 202, the object recogniser 203, 

10 the object database 204, the factual database 205 and the 
message transmitter 206 have the same function as corre- 
sponding Components that have been described above in 
the first embodiment and Fig. 3. The method in the second 
embodiment is the same as has been described above in the 

15 first embodiment. Moreover the following steps take place 
in the second embodiment after making the resemblance 
analysis in step 65. In step 68, the service handler 202 
creates an SMS containing a link and a key to the WAP 
server 207. In step 69, the SMS transmitter 208 sends 

20 this message to the mobile phone 1. The user can then 

contact the WAP server 207 on the link received and log 
on to a personal page using the key received. If the user 
contacts the WAP server 207, the service handler 202 
handles a service where the user can supply more informa- 

25 tion and gain access to additional services in the ser- 
vice server 100. The service handler 2 02 stores the newly 
supplied information in the factual database 205 and the 
object database 204. 

In a third embodiment of the invention, which will 

30 be described with reference to Fig. 5, the service server 
100 comprises a message receiver 301, a service handler 
302, an object recogniser 303, an object database 304, a 
factual database 305, a message transmitter 306 and an 
i-mode server 307. The message receiver 301, the service 
35 handler 302, the object recogniser 303, the object data- 
base 304, the factual database 305 and the message trans- 
mitter 306 have the same function as corresponding compo- 
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nents that have been described above in the first embodi- 
ment and Fig. 3. The method in the third embodiment is 
the same as has been described above in the first embodi- 
ment. The service handler 302 creates in step 66 an MMS 
5 message containing the found object from the object data- 
base 304, information from the factual database 305 and a 
link and a key to the i-mode server 307. In step 67, the 
message transmitter 306 transmits the MMS message to the 
mobile phone 1. The user of the mobile phone 1 can then 

10 contact the i-mode server 307. If the user contacts the 
i-mode server 307, the service handler 302 handles ser- 
vices where the user may supply more information and gain 
access to additional services. The service handler 302 
stores newly supplied information in the factual database 

15 305 and the object database 304. 

If the user receives a link and a key to the WAP 
server 207 or the i-mode server 307, he may, for 
instance, register for a competition about who resembles 
Elvis Presley most. A further conceivable application is 

20 that this competition is presented in the form of a TV 
programme or as some other public event. 

Sound Object 

If the object is a sound, it may, for instance, be a 
25 voice sample of a person where the person's voice is com- 
pared by the object recogniser 103, 203, 303 with the 
voice samples that are stored in the object database 104, 
204, 304, which then constitute a voice database. A voice 
may for instance be recorded by the microphone 14 of the 
30 mobile phone 1. The object recogniser 103, 203, 303 finds 
that voice in the voice database, which may consist of, 
for example, voices of known people, which resembles 
the received voice sample most. The resemblance analysis 
can be made by a frequency analysis of the voice, for 
35 instance. The object recogniser 103, 203, 303 feeds the 

hit result in the form of the voice sample from the voice 
database with its identity to the service handler 102, 
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202, 302 together with an estimated measure of the degree 
of matching in the hit. The service handler 102, 202, 302 
then creates a message with the voice sample, the degree 
of hitting and information about the person whose voice 
5 sample was found, which it collects from the factual 
database 105, 205, 305. For instance, the message may 
contain information that the user sounds most like Elvis 
Presley, does so at the value 68 of 100, and personal 
information about Elvis Presley and also a voice sample 

10 of Elvis. The user also receives a link and a key to 
additional services on the WAP server 207 or i-mode 
server 307 of the service vendor, and may there, for 
example, register for a competition about who sounds most 
like Elvis Presley. A further conceivable application is 

15 that this competition is presented in the form of a radio 
programme . 

Other examples of sound objects are twitterings of 
birds, in which case one gets to know the species from 
which the twittering originates, together with facts from 
20 the factual database about species-typical properties, 
and a sound sample of a bird of the species in question. 
This is also applicable to sounds of engines or musical 
instruments . 

Alternatively, the user may produce a sound object 
25 by making, for instance, a sound recording of the sound 
of a bird, using a mobile phone. This object is sent by 
an MMS message to the service server which makes a resem- 
blance analysis on the sound object. The MMS message may 
also contain text entered by the user and intended for 
30 additional control of the service. This can be informa- 
tion about the selected service variant, location and 
time . 

Image Object and Sound Object 
35 If the object is an image as well as a sound record- 

ing, it may, for instance, constitute a portrait of a 
person, the appearance of the person being compared, by 
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means of the object recogniser 103, 203, 303, with the 
portraits that are stored in the object database 104, 
204, 304 and constitute a voice sample of a person, 
where the voice of the person is compared by means of 
5 the object recogniser 103, 203, 303 with the voice 

samples that are stored in the object database 104, 204, 
304. In this case, the object database 104, 204, 304 con- 
tains both voice samples and portraits. The object recog- 
niser 103, 203, 303 finds that portrait in the object 

10 base 104, 204, 304, which may consist of, for instance, 
portraits of known people, which resembles the received 
portrait most, and finds that voice in the voice data- 
base, which may consist of, for instance, voices of known 
people, which resembles the received voice sample most. 

15 The object recogniser 103, 203, 303 feeds the hit result 
in the form of the portrait and the voice sample from the 
object database 104, 204, 304 with its identities to the 
service handler 102, 202, 302 together with an estimated 
measure indicating the degree of matching of the hit. The 

20 service handler 102, 202, 302 then creates a message with 
the portrait, the voice sample, the hitting degree and 
information about the people in the portrait and the 
voice sample, respectively, which it collects from the 
factual database 105, 205, 305. For instance, the result 

25 data can be that the user resembles Elvis Presley most, 
does so at the value 82 of 100, information about Elvis 
Presley and his portrait and that the user sounds like 
Bruce Springsteen and does so at the value of 88 of 100 
and receives information about Bruce Springsteen and a 

30 voice sample of him. Alternatively, the user will also 

get to know that he sounded like Elvis at the value 18 of 
100 and resembled Bruce at the value 22 of 100. Another 
alternative is that voice and appearance are weighted to 
a combined resemblance value, and in the Example above, 

35 the user gets to know that in respect of voice and 

appearance he resembles Johnny Cash most, does so at the 
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value 73 of 100, and receives information about Johnny 
Cash, his portrait and a voice sample of him. 

The user also receives a link and a key to addi- 
tional services on the WAP server 207 or the i-mode 
5 server 307 of the service vendor, and may there, for 

instance, register for a competition about who resembles 
Johnny Cash most in respect of voice and appearance. A 
further conceivable application is that this competition 
is presented in the form of a TV programme or some other 

10 public event. 

The owner of the service server 100 can alternative- 
ly create an item in the object database 104, 204, 304 
by entering, for instance, a characteristic sound of the 
engine of a motorcycle model. Moreover, a link is created 

15 to an item in the factual database 105, 205, 305, where 
the service provider enters data about the motorcycle 
model. This may involve manufacturer, name of the model, 
year of construction, performance, general agent etc. The 
information can be created as an XML document (eXtens- 

20 ible Markup Language) so that it will be easier to add 
facts . 

Modifications 

It will be appreciated that many modifications of 
25 the above-described embodiments of the invention are 

feasible within the scope of the invention, which is 

defined in the appended claims. 

Other examples of image objects are dogs about which 

one gets to know the breed, along with facts about breed- 
30 specific properties and breeder, and also an image of a 

dog of the breed in question. This is also applicable to 

mushrooms, flowers, leaves or vehicles. 

For instance, the communication device, which in 

the Examples above is a mobile phone, can be a PDA or 
35 some other similar device with the necessary functions 

for recording data and transmitting as well as receiving 

data. 
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The message receiver 101, 201, 301 can handle one 
or more message formats. Examples of such formats are EMS 
(Enhanced Message Service), MMS and e-mail. 

The object can be an image, a sound or be a multi- 
5 media object including sound and image. The user may have 
the option of adding text for additional control of the 
method. This can be information about the selected ser- 
vice variant, i.e. whether it is an image or a sound that 
is to be compared, age, sex and personal data. 

10 The object database 104, 204, 304 and the factual 

database 106, 206, 306 can be updated automatically by 
the users' transmitted objects and facts being added 
continuously. It is convenient to request the user's 
consent thereto. The consent is suitably provided by the 

15 user using the link and the key that can be attached to 
the result message to contact the service provider's WAP 
server 207 or i-mode server 307 and there give his con- 
sent via a safe connection. Alternatively, the user is 
contacted about the option via a separate SMS about this 

20 or via WAP push, so as to prevent violation of national 
laws about storing information about individuals . 

The method can also be used to allow a first user 
of a mobile communication device to find a lookalike. The 
first user can then transmit an image of himself that is 

25 stored in the service server. If /when a second user who 
resembles the first user transmits an image of himself 
to the service server, the- service server can be arranged 
so that both receive information in their mobile phones 
that a lookalike has been found. 

30 If the method is used, for instance, in a competi- 

tion, in which the person is to be found who most resem- 
bles a given celebrity, the user may not to get to know 
whether he resembles anyone in a first stage, and only 
later gets to know that he has won the competition and 

35 how much he resembles a celebrity. 

It is also possible to record an image of a face 
using a digital camera, transmit the image to a PC which 
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is connected to a network, such as the Internet, trans- 
mit the image to the service server 100, which makes 
the resemblance analysis and transmits the result of the 
resemblance analysis back to the PC. In this case, the 
5 digital camera and the PC constitute a communication 

device. The digital camera can be integrated into the PC. 

It is also possible to use encryption software and 
encrypt the recorded object before transmitting it. 

A recorded object can be a fingerprint. resem- 

10 blance analysis is then made using suitable software for 
fingerprint recognition. 

With reference to the first detailed embodiment and 
the block diagram in Fig. 6 and also the flow charts in 
Figs 8 and 9, an additional step can be introduced. After 

15 the service server 100 has received an object in step 60, 
the service server 100 can be arranged to send a WAP push 
to the mobile phone. The WAP push can send a form or a 
reference to a form using, for instance, an MMS, which 
the user of the mobile phone 1 fills in and sends back to 

20 the service server 100 as an MMS. If the method is used 
in dating service, the form may comprise, for instance, 
information about name, sex, length, interests etc. When 
the service server 100 receives the form, the service 
server 100 makes the resemblance analysis based on the 

25 received recorded information and the information receiv- 
ed in the form. 
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CLAIMS 

1. A method for estimating the resemblance of 
5 various objects, comprising the steps of 

recording (40; 50) data of a real object, which is 
a face, using a communication device (1) , 

transferring (41; 52, 60) said recorded data to a 
service server (100; 405), 
10 extracting (42; 64) a comparison object from said 

recorded data, 

making (45; 65) a resemblance analysis between the 
comparison object and a previously stored object, and 

transferring (44; 67) result data containing infor- 
15 mation about the resemblance analysis to a result unit 
(1; 100; 405) . 

2. A method as claimed in claim 1, wherein the step 
of transferring (41; 52, 60) said recorded data to a ser- 
vice server (100; 405) at least partly occurs wirelessly. 

20 3. A method as claimed in claim 1 or 2, wherein the 

step of transferring (41; 52, 60) said recorded data to a 
service server (100; 405) comprises the steps of packag- 
ing (51) said recorded data as a message, transferring 
the message to a service server, and unpackaging (63a) 

25 the message in the service server. 

4. A method as claimed in any one of the preceding 
claims, further comprising the steps of transferring (41) 
the identity of the communication device (1) to the ser- 
vice server (100; 405) and storing (61) the identity in 

30 the service server. 

5. A method as claimed in any one of the preceding 
claims, wherein the result unit consists of the communi- 
cation device (1) . 

6. A method as claimed in any one of the preceding 
35 claims, wherein said result data contains an address 

link. 



WO 2004/038613 



PCT/SE2003/001634 



24 

7 . A method as claimed in any one of the preceding 
claims, wherein said recorded data is a digital image. 

8 . A method as claimed in any one of the preceding 
claims, wherein the service server (100; 405) comprises 

5 a number of stored objects and the resemblance analysis 
comprises the step of 

identifying the stored object which the comparison 
object resembles most. 

9. A method as claimed in claim 10, wherein said 

10 result data contains the identified object which the com- 
parison object resembles most and a measure of the degree 
of resemblance. 

10. A method as claimed in claim 11, wherein said 
result data further contains additional information about 

15 the stored object which the comparison object resembles 
most. 

11 . A method as claimed in any one of the preceding 
claims, further comprising the step of storing the compa- 
rison object in the service server (100; 405) . 

20 12. A method as claimed in any one of the preceding 

claims, wherein the communication device is a mobile 
phone . 

13. A method as claimed in claim 3, wherein the mes- 
sage is an MMS (Multimedia Message Service) message. 
25 14 . A method as claimed in any one of the preceding 

claims, further comprising the steps of 

sending, in response to transferred data, a form to 
the communication device (1), 

recording form data using the communication device 

30 (1), 

transferring said recorded form data to the service 
server, the step of making (45; 65) the resemblance ana- 
lysis comprising the step of using said form data in the 
resemblance analysis. 
35 15. A method for estimating the resemblance of 

various objects, comprising the steps of 
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receiving (60) recorded data of a real object, which 
is a face, 

extracting (42; 64) a comparison object from said 

data, 

5 making (45; 65) a resemblance analysis between the 

comparison object and a previously stored object, and 

transmitting (44; 67) result data containing infor- 
mation about the resemblance analysis. 

16. A method as claimed in claim 15, wherein said 
10 received data is an MMS message. 

17. A method as claimed in claim 15 or 16, further 
comprising the steps of 

sending a form in response to received data, and 
receiving form data, the step of making (45; 65) the 
15 resemblance analysis comprising the step of using said 
form data in the resemblance analysis. 

18. A method as claimed in any one of claims 15-17, 
further comprising the step of identifying the stored 
object which the comparison object resembles most, 

20 said result data containing the identified object 

which the comparison object resembles most and a measure 
of the degree of resemblance. 

19. A method as claimed in any one of claims 15-18, 
further comprising the step of storing the comparison 

25 object in the service server (100; 405) . 

20. A server (100; 405) for estimating the resem- 
blance of various objects, comprising a receiver (101; 
201; 301) which is adapted to receive recorded data of 

a real object, which is a face, an object database (104; 

30 204; 304) which is adapted to store an object, a service 
handler (102; 202; 302) which adapted to extract a compa- 
rison object, an object recogniser (103; 203; 303) which 
is adapted to make a resemblance analysis between the 
comparison object and the stored object, and a transmit- 

35 ter (106; 206; 306) which is adapted to transmit result 
data containing information about the resemblance ana- 
lysis . 
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21. A server (100; 405) as claimed in claim 20, fur- 
ther comprising a factual database (105, 205, 305) which 
is adapted to store information about the stored object. 

22. A server (100; 405) as claimed in claim 20 or 
5 21, further comprising a WAP server. 

23. A server (100; 405) as claimed in any one of 
claims 20-22, further comprising an SMS transmitter. 

24. A server (100; 405) as claimed in any one of 
claims 20-21, further comprising an i-mode server. 

10 25. A server (100; 405) as claimed in any one of 

claims 20-24, wherein the receiver (101; 201; 301) is 
an MMS receiver. 

26. A server (100; 405) as claimed in any one of 
claims 20-25, further adapted to identify the stored 

15 object which the comparison object resembles most, 

said result data containing the identified object 
which the comparison object resembles most and a measure 
of the degree of resemblance. 

27. A server (100; 405) as claimed in any one of 
20 claims 20-26, further adapted to store the comparison 

object. 

28. A server (100; 405) as claimed in any one of 
claims 20-27, further adapted to send, in response to 
said received data, a form, and adapted to receive form 

25 data, the server being adapted to use said form data in 
the resemblance analysis. 

29. A system for estimating the resemblance of 
various objects, comprising a communication device (1) 
which is adapted to record data of a real object and 

30 transfer said recorded data to a server (100; 405) which 
is arranged as claimed in any one of claims 20-28, via a 
network which at least partly is wireless. 

30. Use of the method as claimed in any one of 
claims 1-19 in a TV programme to make a resemblance 

35 analysis between a previously stored object and a large 
number of comparison objects which are extracted from 
received recorded data. 
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